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1.  Introduction 


In  most  physical  phenomena,  changes  in  spatial  or  temporal  structure  occur  over 
a  wide  range  of  scales.  Images  are  no  exception:  changes  in  light  intensity  reflect 
the  many  spatial  scales  at  which  visible  surfaces  are  organized.  It  seems  intuitive 
that  a  great  deal  of  information  can  be  gained  by  an  analysis  of  the  changes  in 
a  signal  at  different  scales.  For  instance,  graphs  of  one-dimensional  functions  are 
a  very  effective  tool  for  describing  complex  systems.  An  important  reason  is  that 
tliey  allow  direct  visual  access  to  important  properties  of  the  data,  chiefly  to  their 
changes  over  different  scales. 

Ilie  idea  of  scale  is  critical  for  a  symbolic  description  of  the  significant  changes 
in  images  or  other  types  of  signals.  Changes  must  be  detected  at  different  levels 
of  detail  and  over  different  extents.  In  general  different  physical  processes  may 
be  associated  w'ith  a  characteristic  behaviour  across  different  scales.  In  an  image, 
changes  of  intensity  take  place  at  many  spatial  scales  depending  on  their  physical 
origin.  A  multiscale  analysis,  tracing  the  behaviour  of  some  feature  of  the  signal 
across  scales,  can  reveal  precious  information  about  the  nature  of  the  underlying 
physical  process.  In  images,  for  instance,  spatial  coincidence  at  all  scales  of  zero- 
crossings  in  the  Laplacian  of  the  intensity  values  filtered  with  a  gaiissian  mask, 
signals  a  physical  "edge",  distinct  from  surface  markings  or  shadows.  Not  only 
is  it  necessary  to  detect  and  describe  changes  in  a  signal  at  different  scales,  but 
in  addition,  much  useful  information  can  be  obtained  by  combining  descriptions 
across  scales. 

The  importance  of  this  idea  has  been  clearly  realized  in  the  field  of  vision.  One 
of  the  main  contributions  of  visual  psychophysics  in  the  last  10  years  was  indeed 
to  show  that  visual  information  is  processed  in  parallel  by  a  number  (perhaps  a 
continuum)  of  spatial-frequency-tuned  channels  (Campbell  &  Robson,  1968).  The 
bulk  of  the  data  demonstrates  that  the  visual  system  analyses  the  image  at  different 
resolutions.  Physiological  experiments  a.e  consistent  with  the  psychophysics.  They 
suggest  that  in  the  visual  pathway  spatial  filters  of  different  size  operate  at  the  same 
location.  Furthermore,  psychophysics,  physiology  and  anatomy  all  show  that  the 
spatial  grain  of  analysis  continuously  changes  from  foveal  to  peripheral  locations. 
Receptive  and  dendritic  field  sizes  of  both  retinal  and  cortical  neurons  increases 
monotonically  with  eccentricity,  in  agreement  with  the  dependency  on  eccentricity 
of  the  psychophysical  channels. 

In  the  field  of  computer  vision,  Rosenfeld  was  one  of  the  first  to  propose  explicitly 
an  edge  detection  scheme-based  on  multiscale  analysis  performed  with  filters  of 
different  sizes  (Rosenfeld  and  Thurston,  1971).  A  similar  algorithm  was  suggested 
by  Marr  (1976)  though  with  dilferent  goals  and  motivations.  More  recently,  he 
has  sinjngly  adv(x:aled  the  use  of  derivatives  of  gaussian-shaped  filters  of  different 
sizes  with  the  goal  of  detecting  changes  in  intensity  at  dilferent  scales  (Marr,  1982). 
The  idea  was  first  proposed  in  the  context  of  a  theory  of  stereomatching  (Marr 
and  Poggio,  1979).  In  that  scheme,  analysis  at  the  difl'erent  scales  was  effectively 
kept  separate.  Later,  Marr  and  Hildreth  (1980)  proposed  some  heuristical  rules  to 


combine  information  from  the  different  channels.  However,  the  important  problem 
of  how  to  combine  eflectively  the  different  scales  of  analysis  at  thisn  early  level  has 
remained  open  ,  although  recent  work  by  D.  Terzopoiilos  (1982)  has  successfully 
applied  multi-level  algorithms  to  the  problem  of  reconstructing  visual  surfaces  (see 
also  the  work  by  Richards  et  al.,  1982  and  by  Canny.  1983  on  edge  detection).  In 
a  recent  conference  (Cold  Spring  Harbour,  April  1983)  we  learned  from  A.  Witkin 
a  new  way  of  describing  zero-crossings  across  scale.^ 

A  1-dimensional  signal  is  smoothed  by  convolution  with  a  small  (large)  gaussian 
filter  and  the  zeros  of  the  second  derivative  are  localized  and  followed  tis  the 
size  of  the  filter  increases  (decreases).  This  procedure  originates  a  plot  of  the 
zero  contours  in  the  i  —  a  plane  (where  a  measures  the  size  of  the  gaussian 
filter).^  In  this  way,  Witkin  was  able  to  classify  and  label  zero-crossings  achieving 
an  effective  description  of  a  signal  for  purposes  of  recognition  and  registration. 
This  is  possible  mainly  because  the  geometry  of  the  zero  contours  is  surprisingly 
simple.  Zero-contours  are  either  lines  from  small  to  very  large  scale  or  closed, 
bowl-like  shapes.  Zero-crossings  are  never  created  as  the  scale  increases.  Witkin 
mentioned  the  striking  result  (obtained  by  J.  Babaud)  that  the  gaussian  filter  is 
the  only  filter  with  this  remarkable  property  in  1-D  (at  the  same  conference  J. 
Koenderink  told  us  that  he  has  obtained  similar  results  exploiting  properties  of 
the  diffusion  equation).® 

We  have  now  succeded  in  obtaining  a  proof  of  this  result  in  2D  (and  in  fact 
any  number  of  dimensions).  We  have  also  obtained  related  results  for  zero-  and 
level-crossings  of  other  differential  operators,  in  particular  for  ridges  and  ravines 
in  the  image  intensity. 

The  2-D  result  seems  important  because  it: 

(a)  lays  the  necessary  mathematical  foundation  for  using  multiresolution  labels  for 
classifying  zero-crossings  for  a  symbolic  description  of  intensity  changes. 

(b)  justifies  the  use  of  gaussian  filters  and  an  associated  linear  derivative  because 
of  their  “nice"  properties  under  changes  in  scale. 

In  this  paper,  we  will  first  state  and  prove  the  one-dimensional  result.  We  will  then 
show  that  only  a  specific  2-D  extension  is  valid.  Zero-crossing  of  linear  derivatives 
have  the  "nice  scaling  behaviour"  if  and  only  if  the  image  is  filtered  by  a  2-D 
rotationally  symmetric  gaussian.  In  particular,  the  laplacian-of-  a-gaussian  filter 
suggested  by  Marr  and  Hildreth  has  nice  scaling  behaviour.  Tlie  second  directional 
derivative  along  the  gradient,  however,  does  not:  no  filler  exists  tliat  can  ensure  a 
nice  scaling  behaviour  of  the  zeros  of  this  derivative.  We  have  then,  the  following 
rcsidjs^ _ 

'  Wilkin’s  pri/c-winning  paper  will  appear  in  the  1983  IJCAl  Proceedings  (Witkin,  1983).  Wc 
received  a  prcpriiu  alter  this  memo  went  to  press. 

Stansficld  first  described  —  for  analysing  commodities  trends  (Stansficld,  1980)  —  tlic  idea  of 
plotting  /ero-crossings  over  scale,  but  did  not  develop  it. 

•’’After  completion  of  this  memo  wc  were  informed  tliat  a  technical  report  containing  the  ID  proof 
is  now  ready,  with  the  title  “Uniqueness  of  the  gaussian  kernel  for  scale-space  filtering,"  by  J. 
Ilabaud,  A.  Witkin  and  R.  Duda,  Kairchild  I'R  645,  Hair  22). 


(a)  for  linear  derivative  operations— in  particular,  for  the  laplacian— the  gaussian 
is  the  only  filter  with  a  nice  scaling  behaviour. 

(b)  for  the  nonlinear  directional  derivative,  no  filter  will  give  nice  scaling  behaviour. 

2.  Assumptions  and  results 

We  will  consider  filtering  the  image  I  with  a  suitable  filter  F  and  then  consider 
the  behaviour  of  the  zero  crossings  as  we  change  the  scale  of  the  filler.  We  make 
five  assumptions  about  the  filter,  and  impose  them  as  boundary  conditions. 

(1)  Filtering  is  shift-invariant  and,  hence,  a  convolution.  We  write  this  as 

F  •  /{i)  =  I  F(x- 

(2)  Tlie  filter  has  no  preferred  scale  length.  In  two  dimensions  standard  results 
of  dimensional  analysis  (Bridgman,  1922)  give  F{x,ff)  =  ^/(=),  where  a  is  the 
scale  of  the  filter.  The  factor  ^  ensures  that  the  filter  is  properly  normalized  at 
all  scales. 

(3)  The  filter  recovers  the  whole  image  at  sufficiently  small  scales.  ITiis  is  expressed 
by  Lima^Q,  F{x,  a)  =  6(i),  where  6(i)  denotes  the  Dirac  delta  function. 

(4)  ITie  position  of  the  centre  of  the  filter  is  independent  of  a.  Otherwise,  zero 
crossings  of  a  step  edge  would  change  their  position  with  change  of  scale. 

(5)  'fhe  filter  goes  to  zero  as  (i( »-+  oo  and  as  or  i-+  cx5. 

As  will  become  apparent,  our  results  are  independent  of  scaling  the  x  axis.  We 
usually  require  that  we  scale  this  axis  so  that  the  filter  is  radially  symmetric,  and 
state  theorems  with  respect  to  such  axes.  However,  we  can  relax  this  requirement 
by  rescaling  the  axes. 

Figure  (1)  shows  the  typical  scaling  behaviour  of  zero  crossings  in  one  dimension 
observed  by  Witkin.  Figure  (2)  shows  possible  behaviour  of  zero  crossings  which 
is  never  empirically  observed  when  the  filter  is  a  Gaussian.  Tlie  generic  properties 
of  the  zero-crossings  curves  in  the  x,a  plane  can  be  derived  from  the  Implicit 
Function  Theorem.  To  yield  a  curve  the  theorem  requires  that  the  Laplacian  of 
the  filtered  image  is  C^.  ^Fherefore  the  filter  must  be  reasonably  smooth.  Observe 
that  filtering  with  a  gaussian  will  ensure  a  output  for  all  images,  because  of 
the  equivalence  with  the  Cauchy  problem  for  the  diffusion  equation.  The  Implicit 
Function  Theorem  may  break  down  at  degenerate  critical  points  when  all  first 
derivatives  of  the  filtered  image  vanish  together  with  the  Hessian.^  These  points 
arc  non-generic  in  the  sense  that  a  small  perturbation  will  destroy  them.  Observe 
that  "true"  zero-crossings  can  only  disappear  in  pairs  in  the  x,a  plane.  Only  trivial 
zeros  that  do  not  cross  zero  can  disappear  by  themselves,  fhey  are,  however,  non 
generic. 

In  one-dimension,  the  zero  crossings  obey 
^  Zeros  of  ihc  Hessian  correspond  to  zeros  of  the  gaussian  curvature. 
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This  equation  gives  i  as  an  implicit  function  of  a,  i.e.,  x  =  x{a).  If  we  vary  i  and 
a  so  that  (2.1)  is  still  siitisfied,  we  obtain 

So  the  tangent  to  the  curve  is  uniquely  defined  at  a  point,  as  are  all  the  higher 
order  derivatives.  This  prevents  the  behaviour  shown  in  Figures  2b,  2c  with  the 
possible  exception  of  the  nongeneric  cases,  when  the  Implicit  Function  llieorem 
breaks  down. 

The  curve  in  Figure  2(a)  is  more  interesting  because  it  corresponds  to  a  pair 
of  zero  crossings  being  “created"  as  the  scale  increases.  The  Implicit  Function 
Theorem  does  not  rule  out  this  case.  It  therefore  seems  natural  to  require  a  filter 
such  that  this  never  occurs.  In  the  following  three  sections,  we  will  prove  some 
theorems  showing  that  such  a  filter  can  only  be  a  gaussian  and,  moreover,  that  not 
all  differential  zero-crossings  operators  can  obey  this  property.  More  precisely,  we 
prove: 

Theorem  1.  In  one-dimension,  with  the  second  derivative,  the  gaussian  is  the  only 
filter— obeying  our  five  boundary  conditions— which  never  creates  zero  crossings 
as  the  scale  increases. 

Theorem  2.  In  two-dimensions,  with  the  laplacian  operator,  the  gaussian  is  the 
only  filter  obeying  the  boundary  conditions  which  never  create  zero  crossings  as 
the  scale  increases. 

Theorem  3.  In  two-dimensions,  with  the  directional  derivative  along  the  gradient, 
there  is  no  filter  obeying  the  boundary  conditions  which  never  creates  zero  crossing 
as  the  scale  increases. 

In  section  (5),  we  show  that  results  similar  to  Theorems  1  and  2  can  be  extended  to 
all  linear  differential  operators  (in  particular,  directional  derivatives)  and  therefore 
to  other  features  of  the  image,  such  as  ravines  and  ridges  (but  not  peaks)  in  the 
image  intensity.  These  theorems  can  be  extended  to  any  dimension,  but  we  will 
not  give  these  extensions  here. 

It  should  be  emphasized  that,  although  zero  crossings  can  only  annihilate  themselves 
in  pairs,  the  intensity  change  corresponding  to  a  zero  crossing  could  become 
arbitrarily  smaller  as  sigma  increases.  The  zero  crossing  would  then  become  so 
weak  that  for  practical  purposes  the  curve  may  terminate. 

3.  The  I'D  case 

Let  the  image  be  I  and  the  filter  be  F.  We  consider  the  zero  crossings  in  the 
filtered  image. 
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F  .  Hz)  =  r  F(z  -  c)J(()d( 
*/— 00 


(3.1) 


Denote  £-i(F  *  /)  by  E.  Hence  Uie  zero  crossings  are  the  solutions  of 

E{x)  =  0.  (3.2) 

These  form  curves  in  the  i  —  a  plane.  The  condition  that  zero  crossings  are  not 
created  at  larger  scales  is  that  for  all  such  curves  a{x)  the  extrema  of  a{x)  are  not 
minima.  Hence,  for  all  points  Xo  such  that  ff'{xo)  =  0,  we  require  that  o''{xo)  <  0. 

Let  t  be  a  parameter  along  a  curve  in  a  —  x  space.  Then 

dE _  dE  dx  dE  da  ,  . 

dt  dx  dt  da  dt 

On  a  curve  of  zero  crossings,  E  =  0.  and  so  ^  =  0  on  such  a  curve.  We  can 
choose  the  parameter  t  to  be  x.  Then,  using  the  Implicit  Function  Theorem,  we 
obtain; 

This  result  vanishes  at  Xo  if  and  only  if 


Ex{xo)  0, 


and  we  calculate 


d'^a{xo)  —Exxjxo) 

dx^  Eo{xo) 

Til  us,  our  filter  must  be  such  that  if 

E{xo)  =  Ex{xo)  =  0 


Exx(^o) 

E.{xo) 


The  Diffusion  Equation  can  be  written  as 


Note  that  by  the  substitution  t  =  ^2^  we  obtain  the  standard  diffusion  equation. 
If  the  filter  F  is  a  gaussian, 

F{x)  =  ^exp{-^},  (3.10) 

then  it  will  obey  the  diffusion  equation  of  which  it  is  the  Green  function  and 
hence  E(x)  will  also  obey  the  equation.  Thus,  ^  i  and  so  a  gaussian  filter 
will  always  satify  conditions  (3.7)  and  (3.8). 

We  now  show  that  the  gaussian  is  the  only  filter  which  satisfies  the  conditions  and 
obeys  the  boundary  conditions  specified  in  section  (1). 

Consider  an  image  which  is  the  sum  of  delta  functions: 

=  E  -  fO-  (311) 

t=i 

It  is  possible  to  generate  any  image  in  this  way  by  taking  the  limit  as  n  h-*.  oo. 

Set 


T(l)  —  F rx(x). 

(3.12) 

Equations  (3.7)  and  (3.8)  yield 

i=l 

(3.13) 

f:A»Tx(x^-Ci)  =  0 
»=i 

(3.14) 

and 

Z)r:==l  ■dt7zx(Xo  ft)  _ 

E?=iATa(xo-f,) 

(3.15) 

We  can  construct  a  counter  example  if  we  can  solve  the  simultaneous  equations 
for  any  Xo,fi...fn  and  any  positive 

X:  AJ[xo  -  ft)  =  0. 
i=l 

(3.16) 

X:A.7;(x„-f.)  =  o. 

i=l 

(3.17) 
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(3.18) 


Z)  -  ft)  =  — 

»=1 

't^T,ixo'-^i)=L  (3.19) 

t=i 

We  can  write  these  as  a  matrix  equation: 


'T{xo  —  ^i)  ...  T{xo  —  ^n)\/Ai\  f  0  \ 

Tx{Xo  fi)  ...  Tx{Xo  fn)  .  _  0 

Txx{Xo  fl)  ...  Txx{Xo  Cn)  •  — 

^Ta{Xg  fi)  ...  T(j{Xo  in)  J^An'  V  1  / 


(3.20) 


Using  Appendix  (1)  a  necessary  and  sufficient  condition  for  it  to  be  impossible 
to  solve  these  equations  for  any  values  of  loifi-  fn  is  that  there  exists  a  vector 
X  =  (Xi,  X2,  X3,  X4)  independent  of  x  such  that 


“f"  ^2Tx{x)  +  \3Txxix)  +  \4Tc{x)  =  0  (3-21) 

and 


— X3£2  4-X4  74o  (3.22) 

Equation  (3.22)  will  be  satisfied  for  all  positive  if  and  only  if 


X3X4  <  0  (3.23) 

Our  boundary  condition  (2)  means  that  F(i),  and  hence  T{x),  cannot  depend  on 
tmy  scale  length.  The  X’s  are  independent  of  x  and  so  to  make  (3.21)  dimensionally 
correct  (Bridgman,  1922)  we  set 

»  0  »  - 
Xi  =  —Of  X2  —  X3  =  c,  X4  =  -  (3.21) 

(T  (T 

and  rewrite  it  as 

“T  bTx  ^  d 

“2  H - E  cTi2  —  -To  (3.25) 

Condition  (3.23)  implies  that  \  is  positive. 

Now  7’  =  so  F  will  also  satisfy  (3.25)  although  it  is  possible  to  add  a  term  ^ 

to  F  where  “  0.  However,  this  term  will  not  satisfy  the  boundary  condition 
(5)  as  I  •->  00  and  so  we  discard  it. 
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Thus,  we  have  shown  that  we  can  always  construct  a  counter  example  unless  our 
filter  F  obeys  to  the  equation 

aF  b  d 

^  +  +  =  (3.26) 

0^0  c 

with  ^  positive.  It  is  shown  in  Appendix  (2)  that  the  only  solution  of  this  equation 
obeying  tlie  boundary  conditions  is  the  gaussian.  Hence  we  obtain  Theorem  (1). 

4.  The  2-D  Case 

We  now  consider  the  two-dimensional  case  when  the  zero  crossing  op  tor  is  the 
laplacian  and  the  image  depends  on  i  =  {x,  y).  Again,  we  consider  .v  filtered 
image 


F .  Hi)  =  rr  F(x  -  £)/(i)d£  (4,1) 

J — oo  J — 00 

We  set 


E{x)  =  V2{F  *  /(i)}  (4.2) 

The  zero  crossings  are  solutions  of  JS(s)  =  0  and  form  surfaces  in  the  three- 
dimensional  (iff)  space.  Our  requirements  that  zero  crossings  are  not  created  at 
larger  scales  is  satisfied  if  the  extrema  of  these  zero  crossing  surfaces  are  either 
maxima  or  saddle  points.  Minima  are  forbidden.  Thus,  if  we  have  a  surface  ff(i,  y) 
and  there  is  a  point  (lo,  yo)  with 

<^x[Xo,  Vo)  =  (TyiXo,  Vo)  =  0  (4.3) 

we  cannot  have  =  0  and  both 

ffxz  ^  ^yy  ^ 

Let  i  be  a  parameter  of  a  curve  of  the  surface  F(x)  =  0.  Then, 

dE  _  dE  dx  dE  dy  dE  da 
dt  dx  dt  dy  dt  da  dt 

Since  we  are  on  the  zero  crossing  surface,  we  have  ^  =  0  and  setting  t 
then  t  =  y,v/Q  obtain 


(4.4) 

(4.5) 
=  X  and 


(4.7) 


Suppose  we  are  at  an  extremum  (lo.t/o).  Choose  the  i  and  y  axes  so  that  they 
coincide  with  the  directions  of  principal  curvature  at  (lo.J/o)-  I  hen  we  calculate 


O'xxi^oi  Vo]  — 


ayy{Xo,  yo)  — 


Elxi^oVo) 

E(j{xo,  j/o) 

(t.8) 

^-"yyi^ot  Vo) 

Eo{xo,  yo) 

(4.9) 

It  should  be  emphasized  that  (4.8)  and  (4.9)  are  true  only  at  an  extremum  of 
a{x,  y)  and  only  if  the  x  and  y  axes  are  taken  along  the  directions  of  the  lines  of 
curvature  (this  ensures  Oxy  =  0). 

As  in  the  1-D  case,  it  follows  that  the  conditions  (3)  and  (4)  will  always  be  satisfied 
if  E  obeys  the  DilTusion  Equation.  Since  if  axx{xo,yo)  and  (ryy{xo,yo)  are  both 
positive,  (4.8)  and  (4.9)  imply  that  and  are  both  negative.  Thus, 

^(ryXotVo}  ^o{Xotyo)  ^ 

a  gaussian  filter  will  always  obey  our  condition. 

We  now  show  that  if  the  filter  is  not  a  gaussian,  we  can  construct  a  counter-example. 
Tlie  argument  is  a  generalization  of  the  proof  of  dTieorem  1.  Let 


n 


/(?)  =  E  -  <i) 

i=l 


(4.10) 


Set 


T{x)  =  V^F{x)  (4.11) 


We  can  construct  a  counter-example  if  we  can  solve  the  matrix  equation  for  any 
lotfi-  •  tfn  and  any  positive  t\  and  l\\ 


(T{xo-^i)  . 

7j(io  fi) 

■  n^o-cn) 

•  Tx[xo  —  u) 

MlX 

o  o 

7y(lo  ^l) 

Ty{^Xo  ^n) 

0 

r ii(xo  fi) 

T  yxx{^o  S'n) 

iyyi'^o  S'l) 

7yy(lo  fn) 

i/t  ) 

1 

H 

1 a{^o  in)  ; 

V' In ' 

\  1 

Using  Appendix  (1),  a  necessary 


and  sulficient  condition  for  no  solution  to  exist 


for  all  is  that  we  can  find  X  =  (Xi,...,X5)  such  that 


>'i((r)  +  >'2'/i(j:) X37y(j) -{  XT/’r'(i)  I  \~\,,Tn{x)~0  (4.13) 
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and 


o 


-£5X4  -  +  Xe  0  (4.14) 

Equation  (4.14)  can  be  satisfied  for  all  positive  and  il  if  and  only  if: 

X4X5  >  0,  X4X6  <  0.  (4.15) 

Again,  boundary  condition  (2)  implies  the  X’s  are  of  form 

Xi  =  -r ,  X2  =  X3  =  — ,  X4  =  Cl,  X5  =  C2,  Xe  =  —  (“llfi) 

a  o  c 

and  T  satisfies 


^  +  -T,  +  +  ciT„  +  CiTyy  =  -To  (4.17) 

a  a  a 

with  C1C2  >  0  and  cyd  >0. 

F  will  satisfy  (4,17)  up  to  a  term  tp  with  =  0,  which  we  can  discard  because 
of  boundary  condition  (5). 

It  is  shown  in  Appendix  (2)  that  the  only  solution  of  (4,17)  which  obeys  our 
conditions  is  the  product  of  two  one-dimensional  gaussians.  If  we  make  the 
additional  assumption  of  symmetry,  we  obtain  a  two-dimensional  symmetric 
gaussian.  Hence,  the  gaussian  is  the  only  filter  which  satisfied  our  condition, 
and  we  have  proven  Theorem  2,  There  is  an  additional  property  of  gaussian 
filters;  allowed  zero-crossing  surfaces  in  the  x,y,a  space  cannot  have  saddle  points 
with  positive  mean  curvature  //,  The  result  of  this  section  forbids  the  existence  of 
upside-down  mountains  (in  the  x,  y,  a  plane)  and  also  of  upside-down  volcanos. 
Sections  of  the  zero-crossings  surfaces  normal  to  the  x,y  plane  may  appear  as 
suggesting  that  lines  of  zero-crossings  are  created.  In  fact,  because  of  saddle  points 
of  the  surface,  zeros  can  be  traced  continuously  along  the  zero-crossing  surface  to 
smaller  and  smaller  scales. 


5.  Further  results 

It  is  clear  that  the  methods  of  proof  we  have  developed  do  not  only  apply  to  zero 
crossings.  For  example,  consider  the  one-dimensional  case  and  look  for  solutions 
of 

±{F.l)  =  0  (5.1) 

I  licse  correspond  to  maxima  and  minima  of  the  filtered  signal  which  we  call  peaks 
and  troughs.  If  we  set  B  =  j'j(F  *  I)  and  duplicate  the  arguments  of  section  (2), 
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we  find  that  having  a  gaussian  filter  is  a  necessary  and  sufiicienl  condition  for 
peaks  and  troughs  not  to  be  created. 

More  generally,  if  L(i)  is  a  differentia!  operator  in  any  dimension  that  commutes 
with  the  diffusion  equation,  then  solutions  of 

L(F  ♦  /)  =  const  (5.2) 

will  not  be  created  if  and  only  if  the  filter  is  gaussian.  Zeros  of  all  linear  differential 
operators  can  be  encompassed  by  Theorem  1. 

In  particular,  in  two  dimensions,  surfaces  obeying  ^{F  *T)  =  0  can  only  be 
created  by  a  non-gaussian  filter.  Tlius,  ridges  and  ravines  whose  creation  necessarily 
involves  creation  of  zeros  along  some  direction,  can  only  be  created,  as  tlie  scale 
increases,  by  a  non-gaussian  filter.  The  argument,  however,  does  not  apply  to 
extremum  points  (non  degenerate  critical  points,  such  as  peaks  and  pits,  where  all 
derivatives  vanish  simultaneously). 

6.  Directional  operator 

We  have  considered  the  two-dimensional  case  when  our  operator  is  the  second 
directional  derivative  along  the  direction  of  the  gradient  in  tlie  filtered  image.  Let 

=  j  j  (6.1) 

The  directional  operator  is 

-  =  -1-—.—  (6.2) 

dt  dxj 

using  the  summation  convention  on  the  j  indices.  The  second  directional  derivative 
along  the  gradient  is  then 


d'^H  HiHjHij 
HkHk 


(6.3) 


where  Hi  =  ^.,Hij  =  and  we  use  the  summation  convention.  We  set 


E{x)  =  IUx)Hj[x)IIij{x)  (6.4) 

The  zero  crossings  lie  on  the  surface  cr(x,  y),  where  F(i)  =  0.  Our  condition  is 
that  if  we  have  a  point  (lo.yo)  where 


(^x{Xo,  Vo)  =  yo)  =  0  (6.5) 
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and  the  i  and  y  axes  are  along  the  direction  of  the  lines  of  curvature  of  the  a{x,  y) 
surface  at  that  point,  then  it  is  impossible  for  both  an  and  Oyy  to  be  negative,  i.e.. 


^xx(^O)  !/o)  ^  ^yyi^otVo)  0 

We  use  the  Implicit  Function  Theorem  to  obtain 


-E, 

Ea 

(6.7) 

-Ey 

B, 

(6.8) 

and  we  calculate 

_  ( _  .  \  Exx{xo}yo) 

Oxx{^o,yo) — 

Ea(Xo,  yj 

(6.9) 

t  \  Eyy[Xo,  yo) 

(6.10) 

Again,  note  that  if  E  obeys  the  Diffusion  Equation,  then  the  conditions  (6.5)  and 
(6.6)  cannot  be  satisfied.  However,  £  is  no  longer  a  linear  function  of  tJie  filter, 
and  so  we  cannot  directly  obtain  a  condition  the  filter  must  satisfy.  Now  set 

Hx)  =  Z)  —  fa) 

a=l 

(6.11) 

we  find 

HiHjHi,  =  AaApA^Fi{a)Fj{l3)Fij{'i) 

(6.12) 

where  the  summation  convention  applies  to  a,/?, 7  as  well  as  to  i,j. 
We  define 


+  F,{a)F,(-,)F.,{l))  +  F4/})F,(-,)F,,(a)  (6.13) 

+  FMF,{a)FiiW  + 

and  write  (6.12)  as 


irjljHij  =  T{aP'i)AaApA^ 


(6.14) 


Wc  can  produce  a  counter-example  if  we  can  satisfy 


TiaP'i) 

7’x(a/?7) 

Ty{ah) 

Txxiap'i) 

Tzy[Q0'l) 

VT<,(q!/?7) 


/  n  \ 

0 

• 

0 

• 

V  .  j 
J 

\  1 

(6.15) 


It  follows  from  Appendix  (2)  that  no  solution  exists  if  there  is  a  ^  =  (Xi,  X2,  X3,  X4,  X5,  Xe) 
such  that 


XiT{a)07)  +  X2r.(a/37)  +  'i^iTy{ap'i)  + 

-f  '^%Tyy[api)  +  \sTa{a{3'))  =  0 

(6.16) 


but 


-/JX4  -  ^iXs  +  Xe  0.  (6.17) 

As  in  section  (3),  we  can  use  dimensional  arguments  to  show  this  means  that 
T{a0'))  satisfies  the  generalized  Diffusion  Equation. 

However,  since  we  require  solutions  to  (6.15)  of  specific  form  AaApA^  it  is  possible 
that  there  are  no  solutions  of  (6.15)  even  if  T(a/37)  does  not  obey  the  generalized 
Diffusion  Equation.  To  rule  this  out,  we  must  show  that  it  is  possible  to  find  a 
solution  of  form  AaApA^.  From  Appendix  (2)  it  is  possible  to  get  a  solution  Bap-j 
of 


rT{a0'))^ 

000 

S- _ 

<Ta(Q0ni)j 

<  .  ) 

(6.18) 


if  and  only  if  the  vector 


f  0  \ 


0 

0 


V  1  / 


lies  in  ihc  spaced  spanned  by  the 


as  Q,  0, ')  vary.  Denote 


by  t*  and 


\Ta{<xMV 

by  where  t  =  1  to  6. 

Each  r‘(Q/?7)  is  symmetric  in  all  indices  and  7  and  so  there  are  N  = 
w(n+i^(«+2)  vectors.  They  have  only  six  components  each  and  so  they  are  not 
linearly  independent.  There  will  be  at  least  N  —  6  linearly  independent  vectors 
such  that 


(6.19) 


If  Tf^aPi)  does  not  obey  the  generalized  Diffusion  Equation  there  will  be  at  least 
one  solution  Bap^  to  (6.18).  The  general  solution  is  of  form 


A^-fi 

^aPT^  H  t^P^aPi 
P=1 

where  ^  is  arbitrary. 

We  now  ask  under  what  conditions  can  we  find  Aa  and  a*  which  satisfy 


(6.20) 


DaP'^  4"  5^  ^^p^^p^  —  AaApA^ 


(6.21) 


From  the  form  of  (6.15)  it  is  clear  that  scaling  the  A's  will  not  affect  the  counter¬ 
example.  Hence,  satisfying  (6.21)  is  equivalent  to  finding  an  Aa  such  that  AnApA^ 
lies  in  the  N-5  dimensional  vector  space  spanned  by  A 

necessary  and  sufficient  condition  is  that  AaApA^  is  perpendicular  to  the  five 
vectors  which  span  the  complement  of  this  N-5  dimensional  space  in  the  full  N 
dimensional  space. 

Let  the  five  vectors  be  and  It  will  be  possible  to 

solve  (6.21)  and  hence  (6.15)  if  we  can  satisfy 

PaP')AfxApAf<i  =  0 
QaP'i^aApAAf  =  0 

T'a^'i^-aApArj  =■  0.  (6.22) 

X ciP'^A^ApAai  —  0 

Yap-jAaApAfj  =  0. 

These  are  a  system  of  five  simultaneous  cubic  equations  in  n  variables.  If  we  take 
n  sufficiently  large,  it  will  always  be  possible  to  solve  them  (Yuille,  in  preparation). 

Thus,  unless  T(a/?7)  obeys  the  generalized  Diffusion  Equation,  it  will  always  be 
possible  to  construct  a  counter-example. 

We  now  show  that  no  reasonable  filter  will  satisfy  these  requirements. 

First  suppose  we  have  a  gaussian  filter  G{x,  a) 

where  m  is  an  arbitrary  number. 

Then  we  find 

C.W  =  (6.24) 


°u(")  = 


-fii  ,  (*-£«)’,,  ,  {*-?.) 


2(7* 


■}  + 


-exp{— 


2a2 


-}  (6.25) 


So  we  obtain 
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(?-^) 


^^”6  — y  •  (2 — -  (x  -  •  (i  -  £t)  -  -  h)  •  (s  -  y 

u-y^u-y  ,  , .  u-y^u-y  , 


{x  —  i^Y{x  —  y 


(s-fr)} 


As  shown  in  Appendix  (2),  the  general  Diffusion  Equation  can  be  written 

-Tx  +  -Ty  +  ClTxx  4-  CiTyy  =  -T„ 

(TO  <J 

If  we  substitute  (6.26)  into  (6,27)  we  see  that  ciTj*  +  c2Tyy  contains  a  term 

(ci  +  c,)  ,  (*-£/  (*-£,)' 


All  other  terms  in  (6.27)  will  be  of  this  form  multiplied  by  powers  of  —  (i  — 
£^)  and  —  From  (6.17),  ci  and  C2  have  the  same  sign  and  so  it  is  impossible 
for  Z  to  be  zero  and,  hence,  (6.27)  cannot  be  satisfied  if  the  filter  is  a  gaussian. 
Now  suppose  we  have  a  filter  which  satisfies  this  requirement  Set  i^  =  ip 
and  integrate  T{a0i)  with  respect  to  and  We  find 

/  /  F,(x  -  QFjix  -  +  (f,  +  i:p)<i£.</£^  =  Fi  ,  F,  .  F.A3X)  (6.29) 


Hence,  with  £^  =  £^,  we  have 


/  /  T{c,p-,)di^dii,  =  Fi  .  Fj  .  Fij{3x) 


(6.30) 


This  will  still  satisfy  the  generalized  Diffusion  Equation  since  T{aPi)  obeys  this 
equation  for  all  values  of  and  From  Appendix  (2),  the  solution  to  the 
generalized  Diffusion  Equation  is  P  *  /(i),  where  /  is  an  arbitrary  function  and 


ms  1  +  r  (v  +  d  ^ 

P(X,  „)  =  - -  )«p{-  — ^  -  ) 


(6.31) 


We  have 


I 


>-■ ' 


y  - 

M 


M 


L4 


f'i  *  Fj  *  F,j{3x)  =  P*  fix)  (G.32) 

The  boundary  condition  (4)  means  that  b,  =  62  =  0  and  wc  can  scale  the  x  and 
y  axes  to  make  P  a  gaussian.  Thus 


Fi  *  Fj  *  Fy(3i)  =  G*  fix)  (6.33) 

We  Fourier  transform  this  equation  denoting  the  fourier  transform  of  a  function 
9(1)  by  T g(w). 


T  F,iu)T  Fjiij)T  F.jiuj)  =  TG(3w)T/(3<4;)  (6.34) 


But  we  have 

TFiiu)  =  —tufiTFitj)  (6.35) 

and 

TC(3a)  =  exp(::^)  (6.36) 

Hence, 

w'{TF(a)}’  =  eip{^}T/{3«)  (6.37) 

and 

(6.38) 

Ihus  F  is  the  convolution  of  a  function  with  a  gaussian  and  obeys  the  Diffusion 
Equation.  But,  as  shown  in  Appendix  2,  the  only  such  filler  which  siilisfies  the 
boundary  conditions  is  a  gaussian. 

So  a  filter  which  obeys  the  conditions  (6.16)  and  (6.17)  must  be  a  gaussian,  and  yet 
a  gaussian  cannot  satisfy  these  conditions.  Therefore,  for  this  directional  operator, 
it  is  impossible  to  satisfy  our  requirement.  Notice  that  if  the  gradient  direction 
does  not  change  rapidly  the  second  directional  derivative  along  the  gradient  can  be 
approximated  by  the  second  derivative  along  the  x  axis,  where  the  x  axis  is  chosen 
in  the  direction  of  the  gradient.  Ihe  arguments  of  section  5  then  show  that  no 
zero-crossings  arc  created  if,  and  only  if,  the  filter  is  gaussian.  If  these  assumptions 
are  sittisfied  at  one  scale,  they  may  break  down  at  larger  stales  because  of  the 
influence  of  other  parts  of  the  image.  Wc  therefore  expect  that  at  large  si  ales 
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zero-crossings  may  be  created  even  for  gaussian  filters,  unless  the  image  is  very 
simple  (for  instance  an  isolated  straight  step-edge). 


7.  Conclusions 


The  behavior  of  the  zero-  (or  level-)  crossings  is  more  complex  in  two  dimensions 
than  in  one  dimension.  In  the  2-D  case,  two  zero  crossing  contours  can  merge 
into  one  closed  contour  as  the  scale  increases.  The  zero-crossing  surface  has 
a  one-dimensional  crossection  (for  given  y,  say)  that  corresponds  to  an  allowed 
one-dimensional  case.  In  2-D,  however,  the  “complementary"  situation  can  also 
occur:  a  closed  zero-crossing  contour  can  split  into  two  as  the  scale  increases,  just 
as  the  trunk  of  a  tree  may  split  into  two  branches.  This  occurs  at  saddle  points 
of  the  zero-crossing  surface.  This  case  would  correspond  in  1-D  to  the  “creation" 
of  a  zero-crossing  (imagine  a  one-dimensional  section  of  the  zero-crossing  surface) 
which  is  forbidden.  In  2-D,  however,  no  new  zero  crossing  is  created,  since  the 
corresponding  surface  is  continuous  down  to  zero  scale.  We  have  constructed 
two-dimensional  examples  of  both  these  two  cases,  using  the  gaussian  filters.  Both 
examples  would  also  work  for  all  other  filters. 

Several  other  functions  have  been  proposed  for  filtering  images.  We  expect  that 
they  only  give  a  nice  scaling  behavior  for  values  of  a  for  which  they  approximate 
the  solution  of  tlie  diffusion  equation.  The  DOG  (difference  of  gaussians)  does  not 
satisfy  the  diffusion  equation,  but  is  a  good  approximation  except  when  a  is  very 
small.  One-dimensional  real  Gabor  functions  (the  product  of  a  gaussian  and  a 
sine  or  a  cosine)  approximate  the  solution  of  the  diffusion  equation  only  for  large 
values  of  a.  Our  conditions  are  violated  even  more  by  the  sine  function  which 
only  satisfies  the  diffusion  equation  at  best  in  a  weak  asymptotic  sense.  Figure 
3  shows  an  example  of  the  zero-crossings  generated  by  the  gaussian  and  the  sine 
filter. 

It  is  interesting  that  our  proof  implies  that  the  difference  equation  is  the  only 
linear  equation  that  has,  with  suitable  boundary  conditions,  a  nice  scaling  behavior 
of  its  solutions.  This  may  have  some  implications  in  physics. 

in  summary,  we  have  shown  that  the  gaussian  is  the  only  filter  that  guarantees  a 
nice  scaling  behavior  of  the  zero-  and  level-crossings  of  linear  differential  operators. 
Notice  that  the  gaussian  need  not  be  symmetric:  elongated  directional  filters, 
obtained  by  stretching  the  axes,  also  have  a  nice  scaling  behaviour.  We  are 
presently  studying  the  practical  use  of  the  scaling  diagrams  (in  2-D)  for  a  symbolic 
representation  of  images,  as  suggested  by  Witkin,  and,  in  particular,  for  solving  the 
correspondance  problem  in  stereo.  In  this  context,  the  robustness  of  the  “scaling 
representation"  under  small  perturbations  of  the  image  is  clearly  critical  and  has 
to  be  carefully  studied. 
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Figure  3  Examples  of  the  zero-crossings  of  the  second  derivative  of  the  gaussian 
(a)  and  of  the  sine  filter  (b)  for  the  same  input  function 
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Appendix  1 


If  we  have  a  matrix  equation 

Bx  =  a 

the  necessary  and  sufficient  condition  for  a  solution  is  that 

(f>ii  bin\  /bn  •••  bln  fli 

. I  =  ranfc(  . 

bfnl  bfnn' 


(1) 


\bml  ...  bn 


Om/ 


(2) 


Hence  a  necessary  and  sufficient  condition  for  the  non-existence  of  a  solution  is 
that  we  can  find  a  vector  X  =  (Xi, . . .,  X^),  such  that 


■  •  •»  ^In)  -f-  ...  ~{-  Xfn(6fnl» . . .)  ^mn)  —  ® 


but  that 


(3) 


-f  •  •  •  X^anv  ^  0. 


(4) 


Appendix  2 

Suppose  we  have  a  generalized  Diffusion  Equation  of  form 

F  ,bF,  dF„ 

a-»  -I - \-cF^^  = - 


(1) 


We  can  remove  the  first  term  by  the  scaling  F  •-+  a~^^I^F.  Consider  the  remaining 
terms 


(2) 


We  write 


F(x.c)  =  —  / 


(3) 


where  /(w,  a)  is  the  Fourier  transform  of  F{x,  a)  with  respect  to  x.  Combining 
(3)  and  (2)  we  obtain 


fc^/  +  c(-wV=-‘'# 

a  a  da 


(4) 


2 


We  integrate  and  get 


f{uj,a)  =  g{a;){e^e-^^}  (5) 

where  9(01)  is  a  function  of  integration  independent  of  a. 

Hence,  substituting  (5)  into  (3)  gives  us 

F{x,a)=  f  g{(jj){e  (6) 

Note  that  we  are  considering  equations  for  which  c/d  is  positive  and  so  the  integral 
is  well  defined.  We  now  apply  the  convolution  theorem  to  (6)  and  get 

F{x,  a)  =  /  X(x  —  f ,  a)n{g)dg  (7) 

where  /i(f)  is  the  fourier  transform  of  g(uf)  and  X{i,<t)  is  the  fourier  transform  of 
We  calculate 


X(i,a)  =  (8) 

Sea 

Thus  the  general  solution  to  (1)  is  of  form 

F{x,a)  =  f  (9) 

We  now  impose  the  boundary  conditions  stated  in  section  (1).  First,  note  that 
X(i,  a)  is  a  gaussian  with  centre  x  =  —be.  The  requirement  that  the  centre  of  the 
filter  does  not  move  implies  that  6  =  0. 

Write 


F{x,a) 


a^  f  — 


and  consider  the  limit  as  a  tends  to  0.  Now, 


(10) 


Lma^o— =<5(1  — C)  (11) 

where  6  denotes  the  Dirac  delta  function.  If  (3)  is  non-zero  the  limits  c*"  F'{x,a) 
will  eiihei  be  undefined  or  zero.  Hence  our  boundary  condition  (.3)  rp’cet  ’  =  0. 
Morever,  substituting  into  (10)  we  obtain 
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Lima^QF{x,  <t)  =  n{x) 


(12) 


and  condition  (3)  means  that  n{x)  must  be  the  delta  function.  Hence,  on 
substituting  this  back  into  (10)  the  only  solutions  of  (1)  which  satisfies  our  boundary 
condition  is  the  gaussian 

G{x,a)  =  -^^~e^^  (13) 

This  analysis  can  be  extended  to  the  two  dimensional  generalized  Diffusion 
Equation 

aF  d  ,  , 

— y -| - 1 - ciFxx C2Fyy  = —Fa  (14) 

a  a  a 

A  similar  argument  shows  that  the  only  solution  obeying  the  boundary  condition 
in  a  two-dimensional  space  is 


G{x,y,a)  = 

V^VciVc2 


We  use  the  symmetry  requirement  of  section  (1)  to  set  ci  —  cj.  Then  we  obtain 

G{x,y,a)  = (16, 
in  c  a‘ 

We  can  scale  the  cr-axis  by  and  write  (13)  and  (16)  as 

=  (J7] 


G{x,y,a)  =  - — jC 
in  a* 

respectively.  This  ensures  that  a  is  the  standard  deviation  of  the  function. 
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